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ABSTRACT 

A  system  consists  of  subsystems  and  performs  satisfactorily  when 
defects  in  subsystems  do  not  cause  its  failure.  For  each  subsystem,  de¬ 
fect  types  are  identified  by  their  nature  and  by  their  level  of  probabil¬ 
istic  influence  on  system  failure  (finite  nuiriber  of  levels)  .  The  sub¬ 
systems  and  possible  defect  types  are  so  defined  that,  for  satisfactory 
system  performance,  a  defect  type  can  occur  at  most  once  in  a  subsystem. 
Also,  for  this  conditional  case,  probabilities  for  a  defect  type  are  not 
influenced  by  occurrence  of  other  defect  types.  Moreover,  the  defect 
types  are  independent  and  have  small  probabilities  with  respect  to  occur¬ 
rence.  System  ability  is  represented  by  the  Readiness  Index  (RI) ,  which 
is  tha  probability  of  no  defect  that  causes  system  failure.  Statistical 
investigation  of  the  RI  is  complicated  by  possible  existence  of  defect 
types  which  have  not  yet  been  identified.  Suitable  data  are  available 
for  each  ccmbinarion  ;f  subsystem  and  level  of  probabilistic  influence  on 
system  failure.  Fu  every  combination,  the  lumber  of  defect  types  occur¬ 
ring  is  observed  over  some  repetitions.  Unbiased  es*. ..mat ion,  also  approx¬ 
imate  tests  and  confidence  intervals,  are  developed  (some  results  are 
conservative  and/or  apply  to  at  least  moderately  large  RI  Valued  . 

*Based  on  work  performed  at  the  Quality  Evaluation  Laboratory,  U.  S 
Naval  Torpedo  Station,  Keyport,  Washington. 

**Research  partially  supported  by  ONR  Contract  N00014-68-A-0515  and  by 
Mobil  Rasearch  and  Development  Corporation.  Based  on  some  methods 
developed  under  NASA  Grant  NGR  44-007-028. 
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INTRODUCTION  AND  DISCUS3ION 

Considered  is  the  ability  of  a  system  (for  example,  a  torpedo)  to 
perform  satisfactorily  over  an  operation.  This  system  is  composed  of 
subsystems  and  performs  satisfactorily  (does  not  fail)  when  occurrence 
of  defects  in  subsystems  does  not  cause  its  failure. 

Within  subsystems,  types  of  defects  are  identified  by  their  nature 
and  also  by  the  probability  that  the  defect  does  not  cause  system  failure. 
Only  a  finite  number  of  levels  are  considered  to  occur  for  the  probability 
that  a  defect  does  not  cause  system  failure.  The  number  of  levels  and 
the  values  for  these  probabilities  are  known  and  can  change  with  the 
subsytem. 

The  ability  of  a  system  is  respresented  by  its  Readiness  Index  (RI) , 
which  is  the  probability  that  no  defect  type  occurs  whose  influence  causes 
system  failure.  Methods  are  developed  for  investigating  the  RI  from  obser¬ 
vational  data.  Observations  are  obtained  for  every  possible  combination 
of  subsystem  and  probability  level  (for  not  causing  system  failure) .  For 
a  given  subsystem,  an  observation  furnishes  the  observed  number  cf  defect 
types  that  have  the  specified  probability  level. 

A  complication  in  investigation  of  the  RI  is  that  there  may  be  defect 
types  whose  existence  has  not  yet  been  identified.  Moreover,  the  number 
of  undiscovered  defect  types,  and  their  correspondence  with  the  possible 
probability  levels,  are  unknown  for  each  subsystem. 

The  results  are  based  on  some  assumptions  that  are  to  hold  for  the 
conditional  case  of  no  system  failure.  These  are: 
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(a)  Any  given  defect  type  can  occur  at  most  once  in  a  subsystem. 

(b)  For  any  defect  type,  the  probability  that  it  does  not  cause  system 
failure  is  not  influenced  by  occurrence  of  other  defect  types  in 
its  subsystem  or  of  defect  types  in  other  subsystems. 

(c)  With  respect  to  occurrence,  all  defect  types  (over  all  subsystems) 
are  statistically  independent. 

(d)  No  probabilities  for  occurrence  of  defect  types  are  of  more  than 
moderate  size  and  almost  all  of  these  probabilities  are  small. 

(e)  The  observational  data  are  statistically  independent  and  data  for 
the  same  subsystem  and  probability  level  combination  constitute  a 
random  sample.  Also,  these  data  are  obtained  under  conditions  that 
correspond  to  the  case  of  a  system  that  has  not  failed. 

(f)  Consideration  of  only  a  finite  (almost  always  small)  number  of 
probability  levels  (for  not  causing  system  failure)  for  each  sub¬ 
system  yields  acceptable  accuracy  for  the  RI  and  its  investigation. 

In  a  number  of  cases,  the  subsystems  and  defect  types  can  be  defined  so 
that  assumptions  (a)  -  (e)  are  met  to  a  reasonable  approximation.  For 
example,  this  seems  to  be  the  case  for  many  situations  involving  torpedoes  . 
New,  consider  assumption  (f) .  Often,  there  are  limitations  on  the  accu¬ 
racy  to  which  the  probability  of  not  causing  system  failure  can  be  deter¬ 
mined  for  a  defect  of  a  given  nature.  Use  of  a  small  set  of  representa¬ 
tive  values,  each  of  which  corresponds  to  an  interval  of  values,  is  about 
as  good  as  can  be  done  under  these  circumstances.  Of  course,  use  of 
enough  levels  (say,  equally  spaced)  should  provide  sufficient  accuracy. 


U] 


However,  too  many  levels  may  not  be  warranted  and  also  can  introduce 
difficulties  in  the  collection  of  enough  data  for  use  of  sane  of  the 
approximate  results  that  are  developed.  With  these  assumptions,  especially 
(b) ,  the  RI  becomes  the  probability  that  the  system  does  not  fail  due  to 
defects. 

The  principal  results  consist  of  an  unbiased  estimate  for  the  RI, 
some  conservative  one-sided  confidence  intervals  and  significance  tests 
for  the  RI,  some  approximate  one-sided  intervals  and  tests  for  the  RI, 
and  some  two-sided  intervals  and  tests  for  the  RI  (conservative  and 
approximate)  .  In  some  cases,  the  RI  is  assumed  to  be  at  least  moderately 
large  or  the  expected  number  of  defects  that  cause  failure  is  assumed  to 
be  small.  Here,  a  conservative  interval  has  a  confidence  coefficient  at 
least  equal  to  a  determined  value  that  is  appropriate  for  intervals.  A 
conservative  test  has  a  significance  level  that  is  at  most  equal  to  a 
determined  value  that  is  suitable  for  tests. 

Notation  and  some  basic  expressions  are  given  in  the  next  section. 

The  following  section  contains  the  unbiased  estimate  for  the  RI,  including 
an  expression  for  the  variance  of  this  estimate  and  an  unbiased  estimate 
of  this  variance.  Inequalities  and  approximations  that  are  used  in  de¬ 
veloping  the  intervals  and  tests  are  stated  in  the  next  following  section. 
The  final  three  sections  contain  tlie  material  on  conservative  one-sided 
intervals  and  tests,  approximate  one-sided  intervals  and  tests,  and  two- 
sided  intervals  and  tests,  respectively.  Additional  material,  associated 
principally  with  the  results  for  intervals  and  tests,  is  given  in  two 


appendices. 
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NOTATION  AND  BASIC  EXPRESSIONS 


Pij 


p.  (u) 
1 


d.  . 
J-3 


dij(u) 


d.  (u) 

l 


Most  of  the  notation  used  is  introduced  here. 

=  conditional  probability  that  if  defect  type  j  occurs  in  subsystem 

i,  (i=l,...,n),  failure  of  the  system  does  not  happen  because  of 

the  occurrence  of  this  defect.  The  defect  types  for  which  p. .  <  1 

13 

are  designated  by  j  =  l,...,m(i)  and  only  these  types  receive 
consideration.  The  value  of  n  is  known  but  the  value  of  m(i)  is 
unknown. 

=  u-th  of  a  set  of  U(i)  possible  values  that  are  considered  to  occur 

for  the  p. .  that  are  less  than  unity.  U(i)  and  all  the  p. (u) 
i]  l 

have  known  values. 

=  probability  that  defect  type  j  occurs  in  subsystem  i. 

=  d.  .  when  j  is  such  that  p.  .  =  p.  (u)  ,  and  equals  zero  otherwise, 
ij  13  i 

(Any  defect  type  corresponds  to  exactly  one  value  of  u.) 
m  (i) 

=  £  d.  .  (u) 

3=1  13 


y  (u)  =  observed  number  of  defect  types  with  conditional  probability  level 
iv 

p. (u)  that  occur  for  the  v-th  observation  on  the  combination  of 

i 

this  probability  level  and  system  i,  where  v  =  l,...,V(i,u)  S  l. 
V(i,u) 

d^  (u)  =  ^  y^v (u) /V (i,u) 

v=l 


n  U(i)  V (i,u) 

sa  =  ^1  ~  Pi  (u)  ]a/V(i,u)  [v  (i,u)  -lj  }  )  ty^.tu)  -  di(u)]a 

i=l  u=l  v=l 


is] 


n  u(i} 

. . EE  [1-P..(u)  ]adi(u)/v(i,u)  ,,  (0  <  e  s  1) 

i=l  uBl 

x_(u,v)  =  randan  variable  that  equals  1  if  defect  type  j  occurs  for  the 

v-th  observation  on  the  combination  of  probability  level  p^(u) 

and  subsystem  i,  where  p^(u)  =  P^j*  and  equals  0  if  defect  type 

j  does  not  occur  for  this  observation,  v  =  1, . . . ,V(i,u) . 

K  =  deviate  of  standardized  normal  distribution  (zero  mean,  unit 
a 

variance)  that  is  exceeded  with  probability  a. 


is  permissible  since  assumption  (c)  guarantees  independence,  with  respect 
to  occurrence,  of  all  defect  types.  Of  course,  V(i,u)  has  the  same  value 
for  all  u  when  the  data  are  obtained  in  this  manner. 

UNBIASED  ESTIMATE 


An  exactly  unbiased  estimate  of  R  is  given  by 

-  »  ®«>r !  VS^U)  ,  /iv'"1! 

R '  ”  "  hbr>  ^  piw  I 

l-l  u=l  L_  V=1  J 


The  unbiased  nature  of  this  estimate  follows  from  the  relation 


Ep^  (U) 


yiv(u) 


r  ,  v(i,u) 

-  W=1 


v(i,u)  y.  (ur 
•  Vp,(u)  1W 


which  holds  for  all  v  on  the  basis  of  assumption  (e) ,  and  the  relation 

m(i)  yiv(u) 

n  [l-x. . (u,v) (1-p  ) ]  =  p. (u) 
j=l  3  3 

Combined  with  assumptions  (a)  -  (c)  and  (e) ,  these  reL  ions  imply  that 


a  n  U(i) 

er  =  n  n  Ep.  (u) 

.  _  i 

1=1  U=1 


y.  (u) 

IV 


n  U(i)  m(i) 

=  n  n  n  e[i-x (u,v>  a-p. .)]  *  r. 

i=l  u=l  j=l  13  3 

A 

The  variance  of  R,  on  the  basis  of  assumptions  (a)  -  (c)  ,  (e)  and 


use  of  ref.  1,  equals 


n  U(i)  / 

II  I!  [varfp.  I 
i=l  u=l  \  1 


y.  (u) 

l  ]/v(i,u)  +  (E[pi(u) 


y.  (u) 
iv 


-v~  r 


[8] 


n  U(i) 

-  n  .  n  .lEfp. tu) 

... i  ^ 


Viv 


i-l  u-1 

When  V(i,u)  £  2  for  all  i  and  u,  this  variance  is  unbiasedly  estimated 
by 

V  (i»u) 


n  U(i)r  yiv(u)T 

n  n  vcbrZIp^ 

1-1  u-1  L  V*1  -J 


.  S  'Trim 


i-l  o-l 


-  1  VF’  yiv<u,T 
V(i.u)  Pi(u>  J 


-1  2y  (u}> 

p  ,u)  iv  \ 
V(i,u)  -1  Pi(u)  /' 

v*l 


since 


p  y.  („n» 

[ytiTur  £  pi(“’  lv  J  '  v*rlpi 


(u) 


yiV<U)]/V(l,„) 


Yiv(u)  ia 

and  {E[p.  (u)  1}  equals 


,  rV(i,U)  (  .-la  _!  VU,UJ  2  (U)N 

£*«  iV  }■ 


-1-  {E{pi(u) 


V(i,u) 


which  follows  from  material  in  ref.  1. 
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INEQUALITIES  AND  APPROXIMATIONS 

First,  suppose  that  the  largest  of  the  d. .{1-p. .)  does  not  exceed 

J  3-D  3-D 

.08  and  that  their  arithmetic  average  does  not  exceed  .02.  This  assump¬ 
tion  is  somewhat  (but  not  much't  more  stringent  than  assumption  (d)  .  The 
value  of  d^jd-p^J  is  the  probability  that  defect  j  occurs  in  system  i 
and  causes  system  failure.  Consider  failure  and  nonfailure  as  the 
outcomes  of  binomial  events  for  each  of  the  M  combinations  for  i  and  j. 
From  ref.  2,  the  Poisson  approximation  is  applicable  to  these  binomial 
events  and 


.  r  fr  1 

■  oxpL‘  k  k 


P(nc  failures)  =  R 


Thus,  with  this  somewhat  stronger  assumption,  approximate  confidence  in¬ 
tervals  and  significance  tests  for  R  are  directly  obtainable  from  inter¬ 
vals  and  tests  for 

n  m(i)  n  U(i) 

£  £  di3(1-pij)  =  £  £d.(u)[i-P.(u)].  (2) 

i-l  j=l  i=l  u=l 

Moreover,  this  approximate  expression  for  R  also  applies  when  a  mild 
form  of  m-dependence  occurs  for  the  data  (so  that  assumption  (e)  is 
violated) . 

Second,  suppose  that  (2)  is  less  than  unity.  Then  (see  ref.  3,  for 
case  of  independence) ,  the  sharp  inequalities 


n  m  (i) 


n  m  (i) 


n  in  — ■  it  ill  \  j./ 

-  £  £  d.  ,(i-p.  ,)£r£  i  ~  -  £  £  d. 

M  3-1  13  13  L  M  fri  j=i  1 


.  (1-p. .) 
D  ID 
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hold.  Also,  by  expansion,  the  upper  bound  is  at  most  equal  to 


n  U(i) 

-  r  E  ^ 

i=l  u=l  L 


-  "  Off)  -i a 

YL  H  <u>  ti-ps  (u>  j  » 

_i=l  U=1  J 


(v>)  [l-pi  (u)  ]  +  h 


(4) 


which  is  not  a  sharp  upper  limit  but  one  that  requires  no  knowledge  of  M. 
When  the  value  of  (2)  is  at  most  .2,  the  sharp  upper  and  lower  bounds 
are  nearly  equal  to  each  other  and  to  (4)  .  Then 


[n  U(i)  -3 

1-^21  H  d.(u)[  1-p.  (u)]  ,  (5) 

i=l  u=l  J 

where  this  expression  for  R  approximately  minimizes  its  maximum  deviation 
from  the  upper  and  lcwer  bounds.  Conservative  intervals  and  tests  for  R 
can  be  obtained  by  use  of  the  sharp  lower  bound  and  by  use  of  (4) .  These 
are  based  on  the  assumption  that  (2)  has  a  value  less  than  unity.  Approx¬ 
imate  intervals  and  tests  can  be  obtained  from  (5)  for  cases  where  the 
value  of  (2)  is  believed  to  be  at  most  .2. 

Sometimes,  more  information  is  available  about  R  than  is  available 
about  the  d^  (1-p^)  or  about  (2)  .  If  R  >  e  1  =  .368,  the  value  of  (2) 
is  less  than  unity  and  both  of  the  inequalities  (3)  hold  for  R  (see 
Appei*3ix  A) .  That  is,both  of  the  inequalities  (3)  and  (4)  are  usable  when 
the  RI  is  of  at  least  moderate  size.  If  R  2  .8,  the  approximation  (5)  is 
also  usable . 

A  fundamental  statistic  used  for  the  confidence  intervals  and  tests 
is 

n  U  (i) 

CE  d(u)  [1-Pi  (u)  ] , 

i=l  u=l  1 


(6) 


which  is  an  unbiased  estimate  of  (2)  .  By  expressing  the  y^(u)  in 

terms  of  the  x. .(u,v) ,  the  variance  of  (6) 'is  easily  seen  to  be 
iD 


n  m(i)U(i) 

LLL  <*-»„>• 

i=l  j=l  u=l 


d . . (u) [ 1-d .  (u) ]/V(i,u) 

ID  !D 


(7) 


The  distribution  of  (6)  should  be  approximately  normal  when  (7)  is  not 
too  small,  which  should  often  be  the  case.  In  deriving  results,  the  dis¬ 
tribution  of  (6)  is  considered  to  be  approximately  normal  for  cases  where 
the  confidence  coefficients  are  not  too  near  unity  (say,  at  most  .995) 
and  the  significance  levels  are  not  too  small  (say,  at  least  .005) . 


On  the  basis  of  assumption  (e) ,  it  is  easily  seen  that  sa  is  an 
unbiased  estimate  of  (7) .  A  conservative  estimate  of  (7) ,  with  a  larger 
expectation  but  smaller  variation  (can  be  much  smaller)  than  sa  ,  is 
provided  by  S(l)a. 


n  m(i)U(i) 

ES(1)3  =  e_1ES(e)a  =  Yi  C  IT  d-P,Jad.  .  (u)/V(i,u)  , 

i=l  =1  u=l  3  13 

which,  according  to  assumption  (d)  ,  should  at  least  roughly  equal  (7)  . 

Use  of  S(e)2  with  an  appropriate  value  for  e  should  provide  a  satis¬ 
factory  approximate  estimate  for  (7)  .  In  many  cases,  the  value  of  (7) 
can  be  assumed  to  be  at  least  ES(.96)a.  Then  use  of  S(.98)a  as  the 
estimate  of  (7)  would  seem  suitable.  The  value  of  ES(.38)a  would  differ 
from  (7)  by  at  most  two  percent,  which  implies  that  one  percent  is  about 
the  maximum  change  that  would  be  appropriate  in  the  corresponding  ex¬ 


pression  for  the  observed  standard  deviation  that  is  used  in  intervals 
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and  tests.  A  one  percent  change  in  the  statistics,  through  adjustment  in 
the  probability  level  used,  does  not  cause  an  important  change  in  the 
confidence  coefficient  and  significance  level  values  that  are  considered. 
Similarly,  the  value  of  (7)  nearly  always  should  be  at  least  ES(.92)a 
when  assumption  (d)  holds.  Then,  use  of  S(.96)s  as  the  estimate  would 
call  for  a  change  of  at  most  about  two  percent  in  the  observed  standard 
deviation.  A  two  percent  change  in  this  statistic  can  be  accomplished 
by  a  moderately  unimportant  change  in  a  confidence  coefficient  or 
significance  level  value. 

In  the  intervals  and  tests  presented,  S(e)a  is  used  as  the  estimate 
of  (7) ,  so  that  S(e)  is  the  observed  standard  deviation.  The  value  for 
e  is  appropriately  chosen  (nearly  always,  so  that  .96  £  6  £  1) .  The 
variance  of  S(e)a  is  obtained  in  Appendix  B.  Approximate  estimation  of 
the  variance  of  S(e)a  is  also  considered  in  Appendix  B. 

CONSERVATIVE  ONE-SIDED  INTERVALS  AND  TESTS 


The  results  of  this  and  the  following  two  sections  are  based  on  the 
assumption  that  the  value  of  (2)  is  less  than  unity  or  th'.t  R  >  .368. 
Also,  the  distribution  of  (6)  is  assumed  to  be  acceptably  near  normality 
for  the  confidence  coefficient  and  significance  level  values  that  are 
considered . 

A  conservative  one-sided  interval  with  random  lower  endpoint  is 
provided  (approximately)  by  the  relation 


n  U(i) 

-EE  d..(u)[l  -  pi(u)]  -  S(e)Ka  £  R 


2  1  -  a  . 


i=l  u=l 


This  follows  from  the  lower  bound  of  (3)  and  occurrence  of  a  distributee 
that  is  approximately  standardized  normal  for  the  quantity 


n  U(i) 


n  U  (i) 


fi-EE  d  (u)  [1  -  p.  (u)  ]  }  -  f  1  -  EE  d. (u)  tl  -  p. (u) ]} 
i=1  U=1  i=l  u=l  1  1 

divided  by  S(e) .  Often,  the  true  confidence  coefficient  value  will  be 

definitely  greater  than  ]  -  a  when  the  value  of  (2)  is  not  substantially 

less  than  unity,  since  R  will  be  substantially  greater  than  its  sharp 

lower  bound.  However,  the  confidence  coefficient  should  often  be  near 

i  -  Of  when  (2)  is  at  most  .2. 

A  conservative  one-sided  interval  with  random  upper  endpoint  is 
provided  (approximately)  by 
„  n  U(i) 


•{r  £  1  -  J]  r  d.(u)[l  -  p.(u)]  +  s(e)K 

V  rtT?  11  ur 

V  1-1  u  1 

p  n  U  (i) 

+  *»  E  C  ai(u)  [i 

Li=i  u=i 


(u)  [1  -  p.(u)]  -  S(e)K  I  Jas  1  -  a. 


K"J) 


This  follows  from  the  approximate  normality  for  (6) ,  the  upper  bound  (4) 
for  K,  and  the  fact  that  1-7+  (1/2) Za  is  a  strictly  monotonically 
decreasing  function  of  Z  for  0  £  Z  <  1.  Here,  the  true  confidence  coef¬ 
ficient  should  be  near  1  -  a  when  the  value  of  (1)  is  at  most  .4. 

Direct  use  of  these  intervals  provides  conservative  one-sided 
significance  tests.  In  all  cases,  the  null  hypothesis  asserts  that  R  =  Rq  , 


where  Rq  is  a  specified  value. 

First,  consider  emphasis  of  the  alternative  hypothesis  R  >  Rq .  For 
this  one-sided  test,  R  =  Rq  is  rejected  in  favor  of  R  >  Rq  if  and  only  if 


[14] 


n  U(i) 

Ro  <  1  EE  d.  (u)  [1  -  j?. (u) ]  -  S ( e)  K  . 
i=l  u=l  1  1 

The  significance  level  of  this  test  is  (approximately)  at  most  a  and  the 
value  used  for  Rq  is  at  least  .368.  Often,  the  true  significance  level 
is  substantially  less  than  a.  However,  it  is  frequently  near  o  when  Rq 
is  at  least  .8. 

Now,  consider  emphasis  of  R  <  Rq  .  For  this  one-sided  test,  R  =  Rq 

is  rejected  in  favor  of  R  <  Rq  if  and  only  if 
n  U  (i) 

Rn  >  1  -  \  ^  d.  (U)  [1  -  p.  (U)  ]  +  S(S)K 

V  t — ,  L — ,  1  1  O' 

1=1  U=1 

U  (i) 

Ed.  (u)  [1  -  p.  (u)  ]  -  S(c) 

l  l 

u=l 

The  significance  level  of  this  test  is  (approximately)  at  most  o'.  The 
true  significance  level  should  often  be  near  a  when  Rq  s  .6. 

APPROXIMATE  ONE-SIDED  INTERVALS  AND  TESTS 
Results  based  on  the  Poisson  approximation  are  considered  first. 
Here,  by  assumption,  the  largest  of  the  d^. (1-p, .)  does  not  exceed  .08 
and  their  arithmetic  average  does  not  exceed  .02.  Also,  the  error  in 
approximating  R  through  (1)  is  assumed  to  be  small  compared  to  variation 
in  the  statistic  (interval  endpoint,  or  test  statistic)  involved. 

An  approximate  one-sided  interval  with  random  lower  endpoint  is 


(15) 


This  follows  from  (1) ,  the  approximate  normality  that  is  assumed  for  (6) , 

— z 

and  the  fact  that  e  is  a  strictly  monotonically  decreasing  function  Z. 

An  approximate  one-sided  interval  with  random  upper  endpoint  is 
furnished  by 


P  |r 


r 


exp 


n 


-  u 

_  i-l 


U  ( i) 

£ 

U=1 


di(u)  (1- 


Pi<u) 


1  +  s(e)K 


•])‘ 


=  1-0. 


(9) 


This  too  follcws  from  (1)  and  the  approximate  normality  assumed  for  (6) . 

Now,  consider  the  case  where  the  approximation  (5)  is  used.  The 

error  in  using  this  approximation  is  assumed  to  be  small  compared  to  the 

variation  in  the  statistic  involved  when  the  value  of  (?)  is  at  most  .2, 

which  is  the  situation  that  is  assumed  to  occur.  Also,  the  additional 

notation  that  L  equals 
O' 


n  U(i) 

rr.ax/o,  1  -  “j  H  L  d  (u)  (1  -  p  (u)  J  -  t  S  { € )  / 2 ]  K  |  . 

V  i*lu*l  J 

is  introduced. 

An  approximate  one-sided  interval  with  random  lower  endpoint  is 
provided  by 

P  (L*  ^  R)  =  1  -  a . 
a 

This  follcws  from  (5)  ,  the  approximate  normality  assumed  for  (6)  ,  the 
small  probability  of  a  negative  value  for 


n  U(i) 

1  -  )  .  /Jd.(u)(l  -  p.(u)]  -  [S(e)/2jK  , 

i*=l  u=l  11  a 


[16] 


and  the  relation 

P(Lff  £  /r)  =  P(L*  £  R)  , 
which  is  generally  valid. 

Likewise,  an  approximate  one-sided  interval  with  random  upper  endpoint 
is  furnished  by 

P(R  £  L*  )  =  1  -  a, 

1-a 

and  has  the  same  kind  of  basis. 

The  null  hypothesis  is  R  =  Rg  and  direct  use  of  the  intervals  provides 
corresponding  one-sided  tests.  Use  of  the  Poisson  approximation  is 
considered  first.. 

For  the  one-sided  test  that  emphasizes  R  >  Rg ,  the  null  hypothesis  is 
rejected  in  favor  of  R  >  Rg  if  and  only  if 


n  U  (i) 


*0 


exp 


[-EE 

_  i=l  u=l 


di(u)  [1-p.  (u)  ] 


-  S (e) 


The  significance  level  of  this  test  is  approximately  a  when  the  assumptions 
for  (S)  are  satisfied  for  the  case  of  R  =  Rg .  These  assumptions  become 
more  readily  acceptable  as  the  value  used  for  Rg  increases  (for  null  uses' . 

For  the  one-sided  test  that  emphasizes  R  <  Rg ,  the  null  hypothesis 
is  rejected  in  favor  of  R  t  Rg  if  and  only  if 


Fo  >  exp 


U(i) 


-  EE  v»i>- 


i=l  u=l 


Pi(u)  ]  +  s  (e)  K 


•] 


This  test  has  a  significance  level  of  approximately  a  when  the  assumptions 
for  (9)  hold  with  R  =  Rg .  Here  too  the  assumptions  are  more  readily 
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acceptable  as  Rq  increases  (for  null  uses) . 

Finally,  consider  the  one-sided  tests  that  are  based  on  (5) .  Here, 
the  values  used  for  Rq  are  at  least  .8. 

For  the  one-sided  test  that  emphasizes  R  >  Rq  ,  the  null  hypothesis  is 
rejected  in  favor  of  R  >  Rq  if  and  only  if  Rq  <  L^8 .  For  tie  test  where 
R  <  Rq  is  emphasized,  R  =  Rq  is  rejected  in  favor  of  R  <  Rq  if  and  only  if 
Rq  >  *  Each  test  has  a  significance  level  that  approximately  equals  a. 

TWO-SIDED  INTERVALS  AND  TESTS 

The  two-sided  confidence  intervals  and  significance  tests  are  obtained 
directly  from  the  one-sided  intervals  and  tests  presented  in  the  preceding 
two  sections.  Consideration  of  their  development  is  limited  to  intervals, 
since  the  two-sided  tests  are  obtained  from  the  two-sided  intervals. 

Specifically,  for  intervals,  let 

P[Ri(ax)  £R],  p[r  £  Rj  to3)  ]  (9) 

define  one-sided  intervals,  where  (approximately)  the  confidence  coefficient 
for  the  first  interval  is  either  1  -  or  at  least  1  -  Ofi  (depending  on 
whether  the  interval  is  approximate  or  conservative,  respectively),  and 
for  the  second  interval  is  either  1  -  or3  or  at  least  1  -  .  In  all  cases. 

Pa (oa)  >  Rf  (ax) .  Then  by  considering  the  complements  of  these  intervals, 

PfR  <  Ri  (a-i >]  ,  PlRjfcva)  <  R] 

define  one-sided  intervals,  where  (approximately)  the  confidence  coefficient 
for  the  first  interval  is  either  ax  or  at  most  aj  ,  and  for  the  second 
interval  is  either  a3  or  at  most  a3  . 

Thus,  a  two-sided  interval  and  its  confidence  coefficient  properties 


art?  provided  by 


[18) 


P[R{  (Of!)  £  R  £  R-J  (Ofa)  ]  =  1  -  P[R  <  Ri  «*!>  1  -  P [ Rq  (0?a)  <  R]  . 

If  both  the  intervals  of  (9)  are  conservative ,  the  confidence  coefficient 
is  (approximately)  at  least  1-0?!  -  Of a,  with  p[r  <  R{  (a1!)]  at  most  q?i 
and  P[Pa  (Qfa)  <  r]  at  most  Qfa .  When  the  first  interval  of  (9)  is  conser¬ 
vative  and  the  second  approximate,  the  confidence  coefficient  is  (approx¬ 
imately)  at  least  1  -  o?i  -  o?a ,  with  P[R  <  Ri  (Qfi)  ]  at  most  q?i  and 
PfRgtog  <  R]  approximately  0fa .  If  the  first  interval  of  (9)  is  approx¬ 
imate  and  the  second  conservative,  the  confidence  coefficient  is  (approx¬ 
imately)  at  least  1  -  o?i  -  dfP  ,  with  P[R  <  R^  (o?i)  ]  approximately  O'!  and 
PtRgteg)  <  R]  at  most  az  .  When  both  intervals  of  (9)  are  approximate, 
the  confidence  coefficient  is  approximately  1  -  Oi  -  <*3 ,  with  p[r  <  Ri(CVi)] 
approximately  Qfi  and  P[Rg  (aa)  <  R]  approximately  o?a  . 

The  assumptions  for  both  of  the  intervals  of  (9)  should  be  satisfied. 
Also,  when  both  intervals  of  (9)  are  approximate,  it  is  desirable  that 
they  both  have  the  same  basis  for  the  approximation  of  R.  Then,  consider¬ 
ations  similar  to  those  in  ref.  4  indicate  that  close  approximation  to 
the  normality  assumption  is  not  so  important,  especially  when  intervals 
with  a?i  =  ofa  are  used. 

The  null  hypothesis  for  tests  is  still  R  -  Rq .  In  all  cases,  the 
alternative  hypothesis  is  R  Rf,  .  Specifically,  R  =  Rq  is  rejected  in 
favor  of  R  /  Bo  if  and  only  if  either  Rq  <  R^  (q?i)  or  Rq  >  Rg  (ora)  .  The 
significance  level  is 

p[Ro  <  R{  (o?i )  |Rq  =  R]  +  P [ Rg  (o-a)  <  Ro  |Ro  =  RJ  , 
and  its  properties  are  determined  from  the  properties  of  these  two 


probabilities.  As  an  example,  suppose  that  both  intervals  of  (9)  are 
conservative.  Then,  P[Ro  <  R{  (a^  |Rq  =  R[  is  at  most  and 

P[Rg  (<2g)  <  Ro  I  Ro  =  RJ  is  at  most  Qfg  .  As  another  example,  suppose  that 
the  first  interval  of  (9)  is  conservative  and  the  second  is  approxinate . 
Then,  p[Rq  <  Rj  (Of*)  |Ro  =  R]  is  et  most  0^  and  P[Rg(o'g)  <  RqIrq  =  R]  is 
approximately  a3 . 

In  determining  null  properties  of  tests,  it  is  only  necessary  that 
the  assumptions  for  the  intervals  (9)  are  satisfied  when  the  null  hypothe 
holds.  Thus,  for  assumptions  expressed  in  terms  of  R,  the  null  value  Ro 
can  be  used  for  R  in  deciding  whether  the  assumptions  hold  (as  was  done 
for  some  one-sided  tests  in  the  preceding  two  sections) . 


r 
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APPENDIX  A 

Here,  it  is  shown  that  the  value  of  (2)  is  less  than  unity  when 
R  >  e  ^ .  From  the  sharp  upper  bound  in  (3) 

P  n  m  (i)  -i  M 

l/M 

so  that  (2)  is  at  lost  M ( 1  -  R  )  which  can  be  expressed  as 
Mfl  -  [1  -  (1  -  R)  )  1/M] 

=  M[1  -  1  +  (1/M)  (1  -  R)  f  (1/2)  (1/M)  (1  -  1/M)  (1  -  R) 3 

+  (1/6)  (1/M)  (1  -  1/M)  (2  -  1/M)  (1  -  R)3  +  •••] 

£  (1  -  R)  +  (1/2)  (1  -  R)a  +  (1/3)  (1  -  R)3  +  ...  =  -log  R, 

e 

Thus,  R  >  e  1  implies  that  (2)  is  less  than  unity. 

APPENDIX  B 

Development  of  the  variance  of  S(e)a  and  of  an  estimate  for  this 
variance  are  considered  here. 

The  same  considerations  that  yielded  (7) ,  the  variance  of  (6) , 
show  that  the  variance  of  S(e)a  is 


n  m(i)U(i) 


-E  E  E  (1  -  p.  ,)4d.  .  (u)  [1  -  d.  .  (u)  ]/V(i,u); 

i=l  j=l  u=l  13  13  13 

A  conservative  estimate  for  the  variance  is  provided  by 
n  U  (i) 

ea  ZT  f1  ■  p.  (u)  ]4d  .  (u)  /V(i,u)  3  , 
i=l  u=l  1  1 

whose  expected  value  is 

n  m(i)U(i) 


!  / ,  (1  -  P--)4d  (u)/V(i,u); 

i=l  i=l  u=l  13 


Using  the  same  basis  as  that  for  estimating  (7) , 

n  U(i) 

-EE  f1  -  P.  (u!  ]4d  (u)/V(i,u) 
i=l  u-1  1 


is  used  as  the  estimate  for  the  variance  of  S(e)°. 
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'3  ABSTRACT 

'  A  system  consists  of  subsystems  and  performs  satisfactorily  when  defects  in 
subsystems  do  not  cause  its  failure.  For  each  subsystem,  defect  types  are  identified 
by  their  nature  and  by  their  level  of  probabilistic  influence  or.  system  failure 
(finite  number  of  levels).  The  subsystems  and  possible  defect  types  are  so  defined 
that,  for  satisfactory  system  performance,  a  defect  tynp  can  occur  at  most  cr.cc  in 
a  subsystem.  Also,  for  this  conditional  case,  prooabilities  for  a  defect  type  are 
not  influenced  by  occurence  of  other  defect  types.  Moreover,  the  defect  types  are 
independent  and  have  small  probabilities  with  respect  to  occurrence.  System 
ability  is  represented  by  the  Readiness  Index  (RI) ,  which  is  the  probability  of  no 
defect  that  causes  system  failure.  Statistical  investigation  of  the  RI  is  compli¬ 
cated  by  possible  existence  of  defect  types  which  have  not  yet  been  identified. 
Suitable  data  are  available  for  each  combination  of  subsystem  and  level  of  probabi¬ 
listic  influence  on  system  failure.  For  every  combination,  the  number  of  defect 
types  occurring  is  observed  over  some  repetitions.  Unbiased  estimation,  also  approx¬ 
imate  tests  and  confidence  intervals,  are  developed  (some  results  are  conservative 
and/or  apply  to  at  least  moderately  large  RI  values). 
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